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Abstract 

We consider the problem of numerical approximation of integrals of random fields over a unit hypercube. 
We use a stratified Monte Carlo quadrature and measure the approximation performance by the mean squared 
error. The quadrature is defined by a finite number of stratified randomly chosen observations with the partition 
generated by a rectangular grid (or design). We study the class of locally stationary random fields whose local 
behavior is like a fractional Brownian field in the mean square sense and find the asymptotic approximation 
accuracy for a sequence of designs for large number of the observations. For the Holder class of random functions, 
we provide an upper bound for the approximation error. Additionally, for a certain class of isotropic random 
functions with an isolated singularity at the origin, we construct a sequence of designs eliminating the effect of 
the singularity point. 
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1 Introduction 

Let ^(t), t G [O,!]'', d > 1, be a continuous random field with finite second moment. We consider the problem 
of numerical approximation of the integral of X over the unit hypercube using finite number of observations. The 
approximation accuracy is measured by the mean squared error. We use a stratified Mon te Carlo quadrature (sMCQ) 
for the integral approximation introduced for deterministic functions by iHabeii (|1966D . The quadrature is defined 
by stratified random observations with the partition generated by a rectangular grid (or design). We use cross 



from this class is studied in, e.g., lAbramowicz and SeleznievI (j2011a 



propose d for stochastic processes by 



regular sequences of designs, generalizing the well known regular sequences pioneered bv lSacks and Ylvisakei ( 1966 ). 
We fo cus on random fields satisfying a l ocal stationarity condition 



Berman 



(1974) and extended for random fields in Abramowicz and Seleznjev i jioila). Approximati o n of random fun ctions 



a); 



Hiisler et al 



(|2003l ): ISeleznievl (|2000l ). For 



quadratic mean (q.m.) continuous locally stationary random functions, we derive an exact asymptotic behavior of the 
approximation accuracy. We propose a method for the asymptotically optimal sampling point distribution between 
the mesh dimensions. We also study optimality of grid allocation along coordinates and provide asymptotic optimality 
results in the one-dimensional case. For q.m. continuous fields satisfying a Holder type condition, we determine an 
upper bound for the approximation accuracy. Furthermore, we investigate a certain class of random fields with 
different q.m. smoothness at the origin (isolated singularity), and construct sequences of designs eliminating the 
effect of the singularity point. 

Approximation of integrals of random functions is a n important problem arising in many research and applied 
areas, li ke environmental and geosciences (Riplev , 2004). communication theory and signal processing ( Masrv and 



Vadrevu, 120091). Regular sampling designs for estimating integrals of stochastic processes are studied in Benhenni 



and Cambanis (|l992). Random designs of sampling points, including strat i fied s ampling for stochastic processes 



are investigated in ICambanis and Masrvl (|1992f ) 



Schoenfelder and Cambanis 



(|l982f ). Minimax results for estimating 



integrals of analytical processes are presented in iBenhenni and Istas (11998 ). Prediction of integrals of stationary 
random fields using the observatio ns on a lattice is discussed in IStein (Il995b ). Quadratures for smooth isotropic 
random functions are investigated in lRitter and Wasilkowskil (|1997l ): ISteinl (|1995al ). Multivariate numerical integration 
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of random fields satisfying Sacks- Ylvisaker conditions is studied in lRitter et al.l ( 19951) . iRitteij pOOOf ) contains a survey 
of various random function approximation and integration problems. Novak ( IQSsh includes a detailed discussion of 
determinis tic and Monte Carlo (randomized) linear methods in various computational problems. We refer to Adler 



and Taylor (|2007l ) for a comprehensive summary of the general theory of random fields. 

The paper is organized as follows. First we introduce a basic notation. In Section 2, we consider a stratified 
Monte Carlo quadrature for continuous random fields which local behavior is like a fractional Brownian field in the 
mean square sense. We derive an exact asymptotics and a formula for the optimal interdimensional sampling point 
distribution. Further, we provide an upper bound for the approximation accuracy for q.m. continuous fields satisfying 
Holder type conditions. In the second part of this section, we study random fields with an isolated singularity at 
the origin and construct sequences of designs eliminating the effect of the singularity. In Section 3, we present the 
results of numerical experiments, while Section 4 contains the proofs of the statements from Section 2. 



1.1 Basic notation 

Let X — X{t),t E V :— [0, 1]'*, d > 1, be a random field defined on a probability space (i7,^,P). Assume that for 
every t, the random variable X{t) lies in the normed linear space L^{il) — L^{il, ^ , P) of random variables with 



finite second moment and identified equivalent elements with respect to P. We set ||^|| :— (E^^ 
We are interested in a numerical approximation of 



,1/2 



for allC e L^ifl). 



I{X) ^ / X{t)dt 

by a quadrature based on N observations for random fields from a space C{T>) of q.m. continuous random fields. 

We introduce the classes of random fields used throughout this paper. For fc < d, let 1 = (^i, . . . , Ik) be a vector of 
positive integers such that h — d', and let Li := — 0, ■■■ ,k, Lq = Q,he the sequence of its cumulative 

sums. Then the vector 1 defines the I- decomposition oiV into T)^ x . . .xT)'', with the Ij-cnhe T)^ — [0, 1]'^ , j = 1, . . . , fc. 
For any s € I?, we denote by the coordinates vector corresponding to the j-th component of the decomposition, 
i.e., 

s^- = s^(l) . . . , SL,) e V^, J = 1, . . . , fc. 

For a vector a = (ai, . . . , ak), < aj < 2, j = 1, . . . ,k, and the decomposition vector 1 = (/i, . . . , Ik), let 

k 



E 



for all s e 2? 



with the Euclidean norms ||s^||, j = 1, . . . , fc. 



For a hyper rectangle A = [oi, 6i] x . . . x [ad, bd] C V and a random field X € C{A), we say that 

(i) X € C"{A, C) if for some a, 1, and a positive constant C, the random field X satisfies the Holder condition, i.e. 



\X{t + s)~X{t) \f <C\\s\ 



for aU t,t + s e A; 



(1) 



(ii) X e B"{A,c{-)) if for some a, 1, and a vector function c(t) = (ci(t), . . . ,Cfc(t)), t £ A, the random field X is 
locally stationary, i.e., 

'|X(t + s)-X(t)||^ , . . . . (2) 



EtiCfe(t)||s^- 



1 as s ^ uniformly in t e ^, 



with positive and continuous functions ci(-), . . . , Cfc(-). We assume additionally that for j — 1, . . . ,k, the function 
Cj(-) is invariant with respect to coordinates permutation within the j-th. component. 



For the classes C° and Bf^, the withincomponent smoothness is defined by the vector a = (ai, . . . ,ak)- We denote 
the vector describing the smoothness for each coordinate by a* — (aJ, . . . , a^), where a* = aj, i = ij-i + 1, . . . , Lj, 
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j = Moreover, for one component fields, i.e., k = 1 and cy. = a, the corresponding Holder and local 

stationary classes are denoted by and B^, respectively. 

Example 1. Let m — (mi, . . . ,mfc) be a decomposition vector of [0, 1]™, and m — ^j- Denote by i?/3,m(t), 

t G [0, 1]™, /3 = (/?!, . . . , Pk), < Pj < 2, j — 1, . . . , k, an m-dimensional fractional Brownian field with covariance 
function r(t,s) — ^ (||t||/3 + ||s||^ — ||t — sWp). Then B/j.m has stationary increments, 

\\Bp,m{t + s)- Bf3.jn{tW = Ml3, t, t + S G [0,1]™, 

and therefore, S/s.m G ^^{1), c(-)) with local stationarity functions ci{t) ~ . . . — Cfc(t) = 1, t S [0, 1]™. In particular, 
if fe = 1, then B/3.m(t), t e [0, 1]™, < /3 < 2, m € N, is an m-dimensional fractional Brownian field with covariance 
function 

r(t,s) = i(||t||^ + ||s||^-||t-s||^), t,t + se [0,1]™. (3) 



Let the hypercube T) be partitioned into hyperre ctangular strata by design points T at, for > 1. We consider 



cross regular sequences of grid designs (see, e.g., lAbramowicz and Seleznievl . l2011a[ ). The designs Tjv := {ti 



(ii^ij , . ■ . , td,ij^) '■ i = (ii, . ■ . , id), < ifc < JT-fc, k — 1, . . . ,d} are defined by the one-dimensional grids 



h*{v)dv^—, i = 0, 1, . . . j = l,...,d, 

where /i*(s), s e [0, 1], = 1, . . . , d, are positive and continuous density functions, say, withindimensional densities, 
and let 

h*{t) := {h\{h),...,hl{U)). 
The interdimensional grid distribution of sampling points is determined by a vector function tt : N — > N'': 

iT*{N) «(7V),...,nS(iV)), 

where limjv_j.oo n'*{N) — oo, = 1, . . . , d, and the condition 

d 

Y[n*{N)^N 
j=l 

is satisfied. We suppress the argument N for n* = n*{N), j = 1, . . . , d, when doing so causes no confusion. 

The introduced classes of random fields have the same smoothness and local behavior for each coordinate of the 
components generated by a decomposition vector L Therefore we use designs with the same within- and interdimen- 
sional grid distributions within the components. Formally, for the partition generated by a vector 1 = (Zi, . . . , Ik), 
we consider cross regular designs Tpf, defined by functions h = {hi, . . . , hk) and 7r(A^) = {ni{N), . . . , nk{N)), in the 
following way: 

K{-) = hj{-), n*=nj, i = -f 1,. . .,Lj, j^l,...,k. 

We call functions hi{-), . . . ,hk{-) and 7r(A^) withincomponent densities and intercomponent grid distribution, re- 
spectively. The corresponding property of a design T/v is denoted by: Tjv is cRS{h,TT,l). I f d = 1, then 1 = 1 



tt(N) — ni{N) — N, and the cross regular sequences become regular sequences introduced by 



Sacks and Ylvisaker 



(|1966f ). We denote such property of the design by: T/v is RS{h). 



For a given cross regular grid design, the hypercube V is partitioned into N disjoint hyperrectangular strata Vi, 
i e I, where I := {i = (ii, . . . ,id), < ik < nl - 1, k = 1,. . .,d}. Let Id = (1, . . . , 1) and 0^ = (0, ... ,0) 
denote a d-dimensional vectors of ones and zeros, respectively. The hyperrectangle 2?i is determined by the vertex 
ti = (ii,ii , . . . , and the main diagonal ri := ti+i^ — ti, i.e., 

A := {t : t = ti + n * s, s e [0, 1]"*} , 
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where denotes the coordinatewise multipUcation, i.e., for x = (xi, . . . , a;^) and y = (yi,...,^^), x * y := 
{xiyi, . . .,Xdyd)- 

Let denote the volume of the hyperrectangle Vi. For a random field X E C(2?), we define a stratified Monte 
Carlo quadrature (sMCQ) on a partition generated by Tjv 

In{X,Tn) -.^ lN{X,TNiK7r,l)) =J2x{rii)\Vi\, 

iei 

where rj^ is uniformly distributed in the stratum i G I. Such defined quadrature is a modification of a well known 
midpoint quadrature. 



2 Results 

Let _B^.„i(t),t e M™, < (3 < 2, m E N, denote an m-dimensional fractional Brownian field with covariance function 
(131). For any u E M™, we denote 



bl3,m{u)^l-[ [ \\U* {t ~ dtdv = E i [ Bi3^jni.U*t)dt ~ Bj3^m{u* T])] , 

^ J[04]" "'[04]'" \"'[0,i]" / 



(4) 



where ry is uniformly distributed in the unit m-hypercube. Then fe/3_,„(u) corresponds to the mean squared error 
(MSE) of a sMCQ based on one observation for a field i3^_m(u * t), t e [0, f]™. 

In the following theorem, we provide an exact asymptotics for the accuracy of a sMCQ for locally stationary 
random fields when cross regular sequences of grid designs are used. 

Theorem 1 Let X E S"(2?,c(-)) be a random field and let I{X) he approximated by sMCQ In{X^Tn), where 
is cRS{h,TT,l). Then 

\\I{X) - In{X,Tn)\\' - - Y. \ asN^oc, 

where 

-'T^ m=l 

and Dj{V) := {l/hj{tL^_,+,), 

Remark 1 // T/y is a systematic sampling, i.e., all withincomponent grid distributions are uniform, hj{s) = 1, 
s E [0, 1], j = 1, . . . , k, then the asymptotic constants are reduced to 



Vj=ba^^l^ Cj{t)dt, j = l,...,fc, 

Jv 

where ba^^i^ := 

The next theorem presents an asymptotically optimal intercomponent grid distribution for a given total number 
of sampling points N. We define 

Ij/O 



where d- p is the harmonic mean of the smoothness parameters a*, j = 1, . . . , d 
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Theorem 2 Let X G i3"(I?,c(-)) he a random field and let I{X) be approximated by sMCQ In{X,Tn), where 
is cRS{h, 71,1). Then 

\\I{X)-lN{X,T^)\f>k asN^^. (5) 

Moreover, for the asymptotically optimal intercomponent grid allocation, 

^ «^ ^ ^ i = 1: ■ • ■ , (6) 

the equality in ([5]) is attained asymptotically. 

In a general setting, numerical procedures can be used for finding optimal densities. However, in practice such 
methods are very computationally demanding. We present a simplification of the asymptotic constant expression for 
one-dimensional components. For a random field X € B"{'D, c(-)) define 



Qj{tL,)-^ f c,{t) f\ h*^{t^) ^dti...dtL,-idtL^+i...dtd, ti, e[0,i], j^l,...,k. 
Moreover, for < /3 < 2, let 

1 



(l + /?)(2 + /3)- 



Proposition 1 Let X G B^(T>,c(-)) be a random field and let I{X) be approximated by sMCQ In{X,Tn), where 
Tn is cRS{h,TT,l). If for some j, I < j < k, Ij = I, then for any regular density hj(-), we have 



1 

Vj=ao.^ I Qj{t)hj{t)-^^+"^Ut. 
Jo 

The j-th withincomponent density minimizing Vj is given by 

Jo Qoiry^dT 

where jj := 1/(2 + aj). Furthermore, for such density, we get 

.1 s 1/7. 

1^ Q.ity^dtj . 

As a direct implication of Proposition [TJ we obtain the following asymptotic result for the approximation of 
integral of locally stationary stochastic processes by a sMCQ, with regular sequences of grid designs. Further, in this 
case, we get the exact formula for the density minimizing the asymptotic constant. 

Corollary 1 Let X e Bf{[0, l],c(-)) be a random process and let I{X) be approximated by sMCQ In{X,T]\j), where 
T]\r is RS{h). Then 

lim N^+°'\\I{X)- lN{X,TN)\f = Oa [ c{t)h{t)-^^+''Ut. 
The density minimizing the asymptotic constant is given by 



J^c{r)^dT 

where 7 :— 1/(2 + q). Furthermore, for such density, we get 



citV 

hopt{t)= , tE[0,l], (7) 



lim N^+°'\\I{X)-lN{X,TN)\f ^a^i I c{t)'<dt 



N^oo 



1/7 
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Now we focus on random fields satisfying the introduced Holder type condition. The following proposition 
provides an upper bound for the accuracy of sMCQ for Holder classes of continuous fields. In addition, we present 
the intercomponent grid distribution leading to an increased rate of the upper bound. 

Proposition 2 Let X e C°(I?, C) be a random field and let I{X) he approximated by sMCQ In{X,Tn), where T^r 
is cRS{h,TT,l). Then 

\\IiX)-MX,T.)\f<^j:^ (8) 

' en 



for positive constants di, . . . ,dk- Moreover if Uj ^ TV''/"^ , j ~ 1, . . . ,k, th 

II I(X) - In{X,Tn) 11^ = (iV-(i+'')) as N 



— ?► oo. 



The approximation rates obtained in the above proposition are optimal in a certain sense, i.e., the rate of conve rgence 



can not be improved in general for random functions satisfying Holder type condition (see, e.g., iRitten . l2000f ). The 
rate of the upper bound corresponds to the optimal rate of Monte Carlo methods for the anisot ropic Holder-Nikolskii 
class, which is a deterministic analogue of the introduced Holder class (see, e.g.. 



Peixin 



Remark 2 It follows from the proof of Proposition [D that ^ holds if 

k 

d, = a„^. /]+"^/'c;^ \{c]:, J = 1, . . . , fc, 



i=l 



where Cj :— l/min<,g[Q x] hj{s), j — 1, . . . Therefore the constants depend only on the parameters of the Holder 
class and the corresponding sampling design. 

2.1 Point singularity at the origin 

In this subsection, we focus on one component random fields, i.e., k — 1, I — d, a = a, and consider the case 
of an isolated point singularity at the origin. More precisely, let a random function X{t), t £ [0,1]'', satisfy the 
smoothness condition ([Ij with a. = /3, /3 E (0,2), for t e [0, 1]''. In addition, let X be locally stationary, ([2]), with 
parameter a > /3, on any hyperrectangle A C [0, l]''\{Od}. We construct sequences of grid designs with an asymptotic 
approximation rate A^~(i+"/''). 

The definition of cRS for k = 1 gives that nj = N'^/'^ and h*{-) — h{-), j = 1, . . . ,c!, for a positive and continuous 
density /i(t), t E [0, 1]. For the density h{-), we define the related distribution functions 

H{t):^ [ h{u)du, G{t) -.^ H-\t) ^ [ g{v)dv, t e [0,1], 



i.e., G{-) is a quantile function for the distribution H. Moreover, by 

g{t):^G'{t)^l/h{G{t)), te[0,l], (9) 
we denote the quantile density function. 

To formulate the forthcoming results, we introduce additional classes of random functions. For a random function 
X eC{V),we say that: 

(iii) X e C2{A, V{-)) for a hyperrectangle A C T> ii X is locally Holder continuous, i.e., if for all t,t + s S A, 

\\X{t + s) - X{t) Ip < V{i) ||s||",0 < a< 2, (10) 

for a positive continuous function V{t),t e A, and some t€{t:t = t + s*u, ue [0,1]'*}. In particular, if 
V{t) — G, t £ A, where C is a positive constant, then X is Holder continuous; 

(iv) X e CB2{[0,l]'^\{Od},c{-),V{-)) if there exist < a < 2 and positive continuous functions c(t), V"(t), t G 
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[0, l]''\{Od}, such that X e C^iA, V{-)) n c(-)) for any hyperrectangle A C [0, l]'^\{Orf}. By definition, we 

have that ^(t) > c(t), t G [0, l]A{Orf}- 

Example 2. Consider a zero mean random field ^^(t), < a < 2, t e [0,1]'^, d > 1, with covariance function 
r(t,s) = exp(- ||t- s||"). Let Fc,/3(t) = || t H''/^ X„(t), t e [0,1]'^, where < /3 < a. Then 

iir..,(t+s)-y„^,(t)ir = (iit+sir-iitir)V2iitiriit+sir(i-eHi^ii^^ 

and it follows by calculus that ¥^,[3 € C^{[0,1]'', M) n CB2i[0,l]'^\{Od},c{-),V{-)) with M = 3, c(t) = 2||t||^, and 
F(t) =/3V4||t||'^-' + 2. 

We say that a positive function /(t), t e R"*, satisfies a shifting condition if there exist positive constants Cl < Cjj, 
C, and a such that 

/(s) < C/(v) for all s, v such that Cl < jj^ <Cu, s, v e [0, a]''\{Od}. (11) 

An example of such function is /(t) = || 1 1|" for any < Cl < Cu < oo and a G R. In the one-dimensional case, 
the condition (1111) is satisfied, e.g. , for any function /(•) which is regularly varying (on the right) at the origin (cf. 



Abramowicz and Seleznjevl . l2011bl ). 



Let X e Cf([0, 1]'^,M) n CS;^([0, l]'^\{04,c(-),F(-)), < /3 < a < 2. For /3 > a - d, we prove that under 
some condition on a local Holder function V{-), the cross regular sequences attain the optimal approximation rate 
]y-(i+a/d)^ Observe that P > a~ d holds for all a, /3 G (0,2) if d > 2 and for d = 1 if /3 > a - 1. Define 
H(t) := {H{ti),...,H{td)), t G [0,1]^ and G(t) =: (G(ti), . . . , G(td)), t G [0,1]''. We formulate the following 
condition: 



(C) Let V^(G(-)) be bounded from above by a function R{-) satisfying the shifting condition (fTTj) with Cl = l/\/3 + d, 
Cu — V3 + d, and such that /^^ R{'H.{t))dt < oo. 

Theorems Let X £ C^{[0,1]'^, M) r\CB°l{[0,l]'^\{Od},c{-),V{-)), a - d < P < a, be a random field and let I {X) be 
approximated by sMCQ In{X,Tn), where is cRS{h,Tr,d). If the local Holder function V{-) satisfies the condition 
(C), then 

If 

\\I{X)-In{X,Tn)\\' ^ j^^^ j^c{t)b^ADi{t))X{h{tra) 'dtasN^^, (12) 
where Di{t) = (l//i(ti), . . . , l/h{td)). 

Now we consider the case d — I and < /3 < a ^ I, which is not inc luded in the above theorem. We co nsider quasi 



regular sequences (qRS) of sampling designs T/v = T[^{h) (see, e.g.. lAbramowicz and Seleznievl . l2011b( ). which are 
a simple modification of the regular sequences. We assume that h{t) is continuous for t G (0, 1], and allow it to be 
unbounded in f = 0. If h{t) is unbounded in i = 0, then h{t) — > +oo as i — > 0+. We denote this property of T/v by: 
T/v is qRS(/i.). The corresponding quantile density function g(t) is assumed to be continuous for t G [0, 1] with the 
convention that ^(O) = if h{t) — -t-oo as f — 0+. 

Let X G Cf([0,l],Af) n CSf((0,l],c(-), V^(-)), < /? < a - 1. We modify the condition (C) and formulate the 
following condition for a local Holder function V{-) and a grid generating density h{-): 

(C) Let V{G{-)) and g{ ) be bounded from above by functions R{-) and r(-), respectively, such that R{-) and r(-) 
satisfy the shifting condition ((TTl) with Cl = 1/2, Cu = 2. Moreover, let R{H{t))r{H{t)y+"dt < oo, and 

Gis) = o as s ^ 0. (13) 
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In the following theorem, we describe the class of generating densities eliminating the effect of the singularity point 
for the asymptotic integral approximation accuracy. 

Theorem 4 Let X e Cf ([0, 1], M) n Ci3f ((0, 1], c(-), V{-)), 0</3<a-l, 6ea random process and let I{X) be 
approximated by sMCQ /Ar(X, T/v), where T/v is qRS{h). Let for the density h{-) and local Holder function V{-), the 
condition (C) hold. Then 

lim N^+''\\I{X)-In{X,Tn)\\^ [ c{t)h(t)-^^+"Ut. (14) 

Remark 3 For d — 1, as indicated in Corollary[^ the density hopt{-) minimizing the asymptotic constant in (|12p 
and (I14p is given by ([T]). Thus if the condition (C) holds for X and hopti-), then hopt{-) is the asymptotically optimal 
density. 



3 Numerical Experiments 

In this section, we present some examples illustrating the obtained results. For given withindimensional densities, 
interdimensional distributions, and covariance functions, we use numerical integration to evaluate the mean squared 
error. Denote by 

e%iX, h, TT, 1) E(/(X) - iNiX, TN)iX, TN{h, tt, 1)))^ 

the mean squared error of sMCQ In{X) with strata generated by the grid T/v. We write huni{ ) to denote the 
vector of withincomponent uniform densities. Analogously, by nuni{-) we denote the uniform interdimensional grid 
distribution, i.e., rii = . . . = n^. 
Example 3. Let 2? = [0, 1]^ and 

X(t) -B„,i(t), te[0,l]3, 

where a = (3/2,1/2) and 1 = (2,1). Then X e {[0 , 1]^ , c{-)) , with c(t) = (1,1), t G [0,1]^, k = 2, a* = 
(3/2,3/2,1/2). We compare behavior of eAr(7r„„i) = e%{X,huni,'^umA) and ejv(7ropt) = e%{X,huni,'^optA), where 
the asymptotically optimal grid distribution iTopt is given by Theorem [2] Figure [1] shows the (fitted) plots of the 
mean squared errors e^(7r„„i) (dashed line) and ej^{Tropt) versus N (in a log-log scale). These plots correspond to 




log(Nl 



Figure 1: The (fitted) plots of e^(7r„„i) (dashed line) and e^(7ropt) (solid line) versus iV in a log-log scale, 
the following asymptotic behavior: 

e%{TTopt) - C3iV-"/io asiV^oo, 

where Ci ~ 0.26, C2 — 0.20, and C3 ~ 0.48. Observe that utilizing the asymptotically optimal intercomponent grid 
distribution leads to an increased rate of convergence. 
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Example 4. Let Y{t),t E [0, 1], be a stochastic process with covariance function r{t, s) = exp(— |s — 1\) and consider 
process 

x{t) = j^Y{t), te[0,i]. 

Then X £ 6?([0,l],c(-)) with a = 1 and c{t) ^ 2/{t + 0.1)2, ^ ^ [q^;^]_ gy Corollary [3 the squared rate of 
approximation for any regular density is N'"^. We compare the behavior of e^(/i„„i) = e'j^{X,huni,'n'uni,^) and 
^'pfihopt) — e%{X, hopt,T^u7ii, 1), where hopt{-) given by (O is the density minimizing the asymptotic constant. Figure 
[2la) shows the (fitted) plots of the mean squared errors ej^{huni) (dashed line) and ej^{hopt) versus N (in a log- log 
scale). These plots correspond to the following asymptotic behavior: 

e%ihopt) ^ C2 N^^ as TV ^ 00 
with Ci ~ 3.03 and C2 — 1.65. Figure [2lb) demonstrates the convergence of the scaled mean squared errors 




(a) (b) 



Figure 2: (a) The (fitted) plots of ej^{huni) (dashed hue) and e%{hopt) (solid line) versus in a log-log scale, (b) 
The convergence of N^e%{huni) (dashed line) and N^e%{hopt) to the corresponding asymptotic constants (dotted 
lines). 

N^e%{huni) and N^e%{hopt) to the corresponding asymptotic constants obtained in Corollary[T] Note the benefit 
in the asymptotic constant for the optimal density hopt{-)- 

Example 5. Consider a random field ^Q(t) = A/TOi^Q.i/5, t G [0,1]^, where Ya^p is defined in the Example 2. 
We compare the behavior of the mean squared errors {Xa^ ) — e\i{X ), i = 1,2,3, with ai = 1/2, 

a2 — 1, and — 3/2. The local Holder function V{t) — ||t||~^^^ -f- 2, t G [0,1]^, satisfies the condition (C). 
Consequently by Theorem [31 the sMCQ with cross regular grid sequences attains the convergence rate A^~(i+"j/2), 
j — 1, 2, 3, respectively, despite the point singularity at origin. Figure [H] shows the fitted plots of the mean squared 
errors e|,(XQ^), j — 1, 2, 3 versus N (in a log- log scale). 

Example 6. Let Xx{t) = 5Bi,3/2(t-^), t G [0, 1], < A < 1, where B^, ^ is a fractional Brownian motion with the 
covariance function ([3|). Then 

Xx G cf/'\[o, 1], M) n CBl'\{Q, 1], c(-), F(.)) 

with M — 5 and c(t) = V{t) — 2'b\'^/'^t^/'^'^^~^\ t G [0,1]. We consider the behavior of the mean squared errors 
for Ai = 1/10, A2 = 1/2, and A3 = 9/10. By Theorem [3l we know that sMCQ with regular grid sequences 
attains the optimal rate of convergence in two latter cases. Figure Ul^a) presents the fitted plots of e'^j^{Xx. , hum) = 
e^j^{X\. , huni, T^uni, d) , j = 1, 2, 3. These plots correspond to the following asymptotic behavior: 

e^(-'fAi , /luni) ^ CiN^'^-^^, 

e%{Xx^^,hum) ^ C3 N-'^-'^ as N oo 
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0.5 1 1.5 



Figure 3 
(dotted) 



: The (fitted) plots of ej^{Xa-), j = 1,2,3, for ai = 1/2 (solid line), a2 = 1 (dashed line), and — 3/2 
versus iV in a log-log scale. 
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Figure 4: (a) The (fitted) plots of e%{Xx^,hum), i = 1,2,3 for Ai = 1/10 (solid line), A2 = 1/2 (dashed line) 
and A3 — 9/10 (dotted line) versus iV in a log-log scale, (b) The (fitted) plots of e%{Xxi,huni) (dashed hue) and 
e'jf{X\^ , hopt) (sohd line) versus iV in a log-log scale. 



with Ci ~ 0.64, C2 — 3.69, and C3 ~ 2.86. Consider now the case Ai = 1/10. By Corollary[TJ the density minimizing 
the asymptotic constant is given by ([7]). Moreover, for such defined /lopt(') the condition (C) is satisfied and by 
TheoremlU the corresponding convergence rate is N^'^-^. FigureUJ^b) shows the (fitted) plots of e'j^{X\-^, hum) and 
e'jf{X\-^, hopt) versus iV in a log-log scale. These plots correspond to the following asymptotic behavior: 

e%{Xx„hum) - 

e%{Xx,,hopt) C4 A^~2.5 as iV ^ 00 

with C4 ~ 0.49 and an increasing convergence rate for the asymptotically optimal density. 

4 Proofs 

Proof of Theorem\^ Let us recall the definitions: 

I{X)^ f X(t)dt, /^^(X)=^X(r,i)|I?^|, 

iGl 

where rj; is uniformly distributed in the hyperrectangle i e I. Define the error of numerical integration 
Sn{X) :^I{X)-In{X)^ f X{t)dt-J2x{Vi)m^Y. f {X{t) - X{rj,))dt, 



iei 



iei 



10 



where Eri^N{X) = 0. Denote by = e^(X) := ESn(X)'^ the corresponding mean squared error. By the uniformity 
and independence of r/;,! G I, we obtain the following expression for the MSE: 



^6N{Xf = ExE^,5jv(X)2 = ExVar^(<5jv(X)) = Ex (^I] Var^ (^(t) - X{r],))dt 
= Ex E^ (^^ (X(t) - X(r,0)dt) j = Ex (^g E^ (^^ ^ (X(t) - X(T,i))(X(s) - X(r,i))dtds^ 

= lY^^^if I idxit,Vi) + dx{s..Vi)-dx{s,t))dtds] f f dx{t,v)dtdv, (15) 

where dx(s,t) :— \\X{t) — X(s)|p is the incremental variance of the random field X. Now the local stationarity 
condition ^ implies that 



p2 



\ (EE^^(t-)X X (||t^ -v^"|r^)dtdvj (l + g^,i), 



iei j=i 



(16) 



where by the positivenes s and uniform continuity of local s tationarity functions, we have that ex — maxUgxal? i G 
1} = o(l) as — ?► oo fcf. lAbramowicz and Seleznievl . l2011al ). Recall that the hyperrectangle 2?i is determined by the 
vertex ti — (ti^i^ , ■ • ■ , td.ia) ^-iid the main diagonal ri = tj+i^ — ti, i.e., 

X>i {t : t = ti + r; * s, s e [0, l]"*} . 

It follows from the definition and the mean (integral) value theorem that 



n = (ri,i,,...,rd,»J 



Denote by Wj := (wi.ij , . . . , Wd^i^)- By the definition of cRS{h, tt, 1), we get 



, Wm,i^ e [tm,i^,tm,i^ + l], m = 1, . . . ,d. (17) 



— D,{^1), J = l,...,fc, 



where Dj{V) — {\/hj{tL. ... ,l/hj{tL.)), j = l,...,fc. Consequently, changing variables V = tj + t"' * T;, 
v-' = tj + v-' * Tj , j = 1, . . . , fc, i e I, gives 



ex 



Dj (w^ ) * (t^ - v^' ) dt^ dvM (1 + o(l)) 



as TV — >■ oo. Applying the uniform continuity of withincomponent densities, we obtain that 

^^ = M Ei^ii'E^^(tiK"V / ^.(ti)*(t'-v^) "'dFdvn(i+o(i)) 

^ V iei 3=1 -^^^ -^^^ / 

= (El^il'E^^-(t'K"^^^a.^ (^.(ti))) (1 + 0(1)) asiV^oo, 
\ iei i=i / 

where ba^^i^ (•), j = 1, . . . , fc, are defined by By equation pTl) . we have that 



ill "m^imK":*™) ^ ill ^mCw'm.i™) 
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with Wm.im G [im,i„, ^m,i,„+i], i G I, m = 1 , . . . , d. Furthermore, the uniform continuity of the withincomponent 
densities impUes 

= (ei^'I^ ri h*(t ) E^.-(ti)^"-^c,..,..p(V)))(i + o(i)) 

= (4E^"^E^^(*i)^".^(^(*i')) ri (1+0(1)) asTV^oo. 



\ j = l iGl m=l 

Finahy, the Riemann integrability of Cj{t)baj,ij {D{t)) 11™=! ^m(^ni)^^ gives 



(j^T.^P I c,(t)6„,,,(D(t^)) n /i:jt„0-'dt](l+o(l))= (lX^-J^)(l + o(l)) 
\ i=i ^ m=i / \ j=i i / 



3 

as N —>■ oo. This completes the proof. 

Proof of Theorem\^ The proof is based on the inequahty for the arithmetic and geometric means (cf. Abramowicz 
and Seleznjev, 2011a), i.e., 

i/fe 

with equahty if only if 

t^"^ = i = l,...,fc. 
Hence, the equality is attained for fij = (lyvjY^"^ , j = 1, . . . ,k. Let 

rij = [rij] - (i^Vj)^^"' as N ^ oo. (18) 
This implies that for the asymptotically optimal intercomponent knot distribution 

k 



and therefore, 

z/ ~ N^K^P as iV ^ oo. 
By equation (jlSp . the asymptotically optimal intercomponent knot distribution is 

n, ^ as iV — ^ oo, j — 1, .... k. 

Moreover, with such knot distribution, the equality in ([5]) is attained asymptotically. This completes the proof. 

Proof of Proposition {l\ The proof follows directly from the proof of Theorem 1. The expression for the optimal 
withincomponent density follows from Seleznjev(2000). 

Proof of Proposition\^ The first steps of the proof repeat those of Theorem [TJ Applying the Holder condition ([T]) to 
equation yields 



k k L/j 

iei j=i "'^i "'^'i iei j=i m=L3_i+i-^^i •^■^i 



12 



where the last inequahty follows from the fact that any nonnegative numbers ai , . . . , and any a G K+ , the 
inequality 

/ fc \ " k 

E«g <fc"E«" (19) 

\i=l / 1=1 

holds. Consequently, changing variables t = {t„i - tm,i„,)lrra,i„,, v = {vm ~ tm,ij)lr„i,i^-, m = 1, . . . , d, i e I, gives 

iel j"=l m=Lj_i + l '^'^ iel i=l m=Lj_i+l 

where = 1/2 |i — s|"di(is = 1/((1 + a)(2 + a)). By the continuity of the withincomponent densities and the 
mean value theorem, we have that 

?-m,»,„<^, ie I, TO= l,...,d (20) 
with C*j = l/min^gjo 1] h*^{s). Moreover, the definition of ci?5(/i, vr, 1) implies that 

4 < c ( n E -.^r-^^^ (^)" E 4 1 

with dj = aQ,^/j^"^^^(C2 .)"j Ilm^i J ~ 1, . . . , fc. The formula for the asymptotically optimal intercomponent 
grid distribution follows from the proof of Theorem [2j This completes the proof. 



Proof of Theorem The first steps of the proof repeat those of Theorem 1 . Consider equation (jisp . The MSE can 
be decomposed as follows: 



with 



-N^l'Y / dx{t, v)dtdv = e? jv 
^ igi Jv, Jv, 

i / / dx{t,x)dtdw. 



p2 



For a fixed S > 0, we denote A := [0, 5]'', and Ia {i : I'i n A 0}. Consequently, 

= E ^In = ^Oa:N + E ^In + E ^^.^^ ^ S1+S2 + S3, 
iei ieiA\{Od} iei\iA 

where Si = Si{N) := e^^jy, = S'3(A^) includes all terms ei,jv such that A C X'\A, and S'2 = S'2(iV) := e^-5i-53. 
For 5*1, the Holder condition, p^ . and (PU)) imply that 

Co, AT < c/" /" ||t- vll'^dtdv < ^ /" /" |t„-i>,„|'5dtdv 

< qPoJ V/^a^ E ^™,o < (21) 

for a positive constant Ci. Hence Cq^^ n = o(7V^(^+"/'')) for any f3 e (0, 2), a G (0, 2), if d > 2, and for /3 > a - 1, if 
d = 1. For S'2 by the local Holder condition (|10l) . we obtain the following upper bound 

-^2= E ^^.^^ E / f dxit,s)dtds< Y ^(^i) / / l|t-s|rdtds 

for Vi G i G lA\{0(i}. The continuity of withincomponent grid generating densities together and the definition 
of function G(-) and condition (C) give 

S2 < CiN-^^+'^Z'^^ E ^(G(wi))|A| < CiA^-(i+"/'^) Y ^(wi)lAl, 
ieiA\{Od} ieiA\{Od} 
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where Ci is a positive constant and Wi e [«i/nj, (ii + l)/n*] x . . . x [i^/n'^, {id + —■ T^l- The shifting property 

pT|) implies that for a positive constant C2, 



^2 < C2Ar-(i+"/'^) ^ i?(si)pi|, (22) 
ieiA\{Od} 



where Si = H(ui) G I?;* is such that 



i?(si) = i?(H(ui)) - min i?(H(vi)), i e lA\{Orf}. 
Consequently by ([^ and condition (C), we have 

S2 < C2N-^^+°'/'^^ [ i?(H(t))dt. 

Thus for any e > and sufficiently small 5 by condition (C), we obtain that 

^i+a/d^^ < C / i?(H(t))dt < e. (23) 

For 5*3, similarly to Theorem [1] we get that 

^i+a/d^^ f c{t)b^ADi{t)) n /i(t™)-idt 1 (1 + o(l)) := t-i.5(l + o(l)) as iV ^ 00, (24) 

where I?i(t) = (l/ft,(ii), . . . , l//i(irf)). From the regularity of the withincomponent density and condition (C) it 
follows that for a positive constant Ci , 

/ c(t)6„,<j(Di(t)) TT hitmy^dt <Ci [ c(t)dt <Ci [ V{t)dt <Ci [ R{H{t))dt < 00 
Jv Jv Jt> Jv 



and therefore the monotone convergence gives 



P d 

c{t)b^,d{Di{t))\\h{t^r^dt as (5^0. (25) 
Jv 1 



So, for any e > 0, first we select 5 sufficiently small and apply and Then for the selected 5 and sufficiently 
large TV, ([21]) and ((24l) imply the assertion. This completes the proof. 

Proof of Theorem^ The first steps of the proof repeat those of Theorem 1. Consider equation (|T5|) and decompose 
the MSE as in the proof of Theorem [3] 

1 rU+i r-U+i N-1 



N -22 / dx{t,v)dtdv = 2J e-,7v 



with 



Moreover, let for fixed 5 > Q 



p2 



^iN = 7;l I dx{t,v)dtdv, i = l,...,N. 



2 



N-l Js N~l 

=^o,n + J2^1n+ Y1 elf^ = Si + S2 + S3, 

i=0 1=1 j=Js + l 



where Si — Si{N) e^j^, S3 — S3{N) includes all terms a^N such that [ti,ti+i] C [(5,1], say, i > J5 + 1, and 
S2 = S2{N) :— — 5i — 53. For Si, the Holder condition and the definition of function G(-) implies that 



(i, w)(itdu <-M['['\t- vfdtdv = Mtl+^ap < CG (— 
2 ./o Jo Jo Jq \^ 



Si = l I I dx 
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for a positive constant C. By condition (C), we obtain that 

/ \ 2+/3 

N^+'^Si<CN^+°'G{ — \ = C7V1+"o(7V-(i+")) = o(1). (26) 

We proceed to calculating the upper bound for iS'2. By the local Holder continuity (ITO)) and the mean value theorem, 
we obtain that 

S2 = Y.elj,<\Y. dx{t,v)dtdv<\Y.^{G{w,)) T""' \t - vrdtdv = a^Y.V{G{w.))rl^''^ 

i=\ ^ ^=\ ^ i=\ •'t^ •'t^ i=l 

Js 

where Wi,Vi e [i/N, (i + 1)/A^] and C is a positive constant. Now applying the shifting property and condition 
(C), we get 

iVi+"52 < CJ2r^V{G{w,))g{v,y+'' < Ci ^ r,i?(s,)r(sOi+" < Ci f R{H{t))r{H{t)Y+'-dt, 
1=1 i=i -^'i 

where for = iJ(M^) G [i/N, {i + l)/N], 

R{si)r{s,y+'' = R{H{u,))r{H{u,)f+" = min R{H{t))r{H{t)f+". 

te[t.,t,+i] 

Thus for any e > and sufficiently small 5 by condition (C), we have 

N^+°'S2 <Ci R{H{t))r{H{t))^+°'dt < e. 
Jti 

For 5*3, we obtain that 

N^+"S3 = ^ c(t)/i-(^+")dt(l + 0(1)) =: qsil + 0(1)) as ^ 00. (28) 
It follows by the equation © and condition (C) that 

c{t)h{t)-^'^+°'Ut ^ f c{t)g{H{t)f+'^dt< [ V{t)g{H{t))^+°'dt < f R{H{t))g{H{t))^+"dt < 00 
Jo Jo Jo 



(27) 



and the monotone convergence gives 



"1 

qstq-=aa I c{t)h{t)-^^+°'Ut as (5 ^ 0. (29) 







So, for any e > 0, first we select 5 sufficiently small and apply ((^7)) and (I^H]) . Then for the selected 5 and sufficiently 
large iV, p6|) and p8|) imply the assertion. This completes the proof. 



Acknowledgments 

The second author is partly supported by the Swedish Research Council grant 2009-4489 and the project "Digital 
Zoo" funded by the European Regional Development Fund. 

References 

Abramowicz, K., Seleznjev, O., 2011a. Multivariate piecewise linear interpolation of a random field. arXiv:1102.1871 



15 



Abramowicz, K., Solcznjcv. O., 2011b. Spline approximation of a random process with singularity. J. Statist. Plann. 

Inference 141, 1333 1342. 

Adler, R., Taylor, J., 2007. Random fields and geometry. Springer Verlag, New York. 

Benhenni, K., Cambanis, S., 1992. Sampling designs for estimating integrals of stochastic processes. Ann. Statist. 
20, 161-194. 

Benhenni, K., Istas, J., 1998. Minimax results for estimating integrals of analytic processes. ESAIM Probab. Stat. 
2, 109-121. 

Berman, S.M., 1974. Sojourns and extremes of Gaussian process. Ann. Probab. 2, 999-1026. 

Cambanis, S., Masry, E., 1992. Trapezoidal stratified Monte Carlo integration. SIAM J. Numer. Anal. 29, 284-301. 
Haber, S., 1966. A modified Monte-Carlo quadrature. Math. Comp. 20, 361-368. 

Hiisler. J., Pitcrbarg, V., Scleznjev, O., 2003. On convergence of the uniform norms for Gaussian processes and linear 
approximation problems. Ann. Appl. Probab. 13, 1615-1653. 

Masry, E., Vadrcvu, A., 2009. Random sampling estimates of Fourier transforms: antithetical stratified Monte Carlo. 
IEEE Trans. Signal Process. 57, 194-204. 

Novak, E., 1988. Deterministic and stochastic error bounds in numerical analysis. Springer- Verlag, Berlin. 

Peixin, Y., 2005. Computational complexity of the integration problem for anisotropic classes. Adv. Comput. Math. 
23, 375-392. 

Ripley, B., 2004. Spatial statistics. Wiley-Blackwell, New Jersey. 

Ritter, K., 2000. Avcragc-casc analysis of numerical problems. Springer- Verlag, Berlin. 

Ritter, K., Wasilkowski, G., 1997. Cubaturc and reconstruction of smooth isotropic random function, in: Mahren- 
holtz, O., Marti, K., Mennicken, R. (Eds.), Applied Stochastics and Optimization. Academic Verlag, pp. 120-124. 

Ritter, K., Wasilkowski, G.W., Wozniakowski, H., 1995. Multivariate integration and approximation for random 
fields satisfying Sacks- Ylvisaker conditions. Ann. Appl. Probab 5, 518-540. 

Sacks, J., Ylvisaker, D., 1966. Designs for regression problems with correlated errors. Ann. Math. Statist. 37, 66-89. 

Schoenfelder, C, Cambanis, S., 1982. Random designs for estimating integrals of stochastic processes. Ann. Statist. 
10, 526-538. 

Seleznjev, O., 2000. Spline approximation of stochastic processes and design problems. J. Statist. Plann. Inference 
84, 249-262. 

Stein, M., 1995a. Locally lattice sampling designs for isotropic random fields. Ann. Statist. 23, 1991-2012. 

Stein, M., 1995b. Predicting integrals of random field using observations on a lattice. Ann. Statist. 23, 1975-1990. 



16 



